Mobile device with a pressure and indentation sensitive multi-touch display

ABSTRACT

A multi-touch display layer of a mobile electronic device may be configured with a tactile area on a clear layer on the multi-touch display layer. The mobile electronic device may display a view of information based on applied force from a detected touch to the tactile area and a detected indentation level of the clear layer. The mobile electronic device may display a menu based on a detected further indentation of the tactile area on the clear layer

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/291,375 filed Nov. 8, 2011, which is a continuation of U.S. patentapplication Ser. No. 12/406,273 filed Mar. 18, 2009, which issued asU.S. Pat. No. 8,686,951 on Apr. 1, 2014, the contents of which are allhereby incorporated by reference herein as if fully set forth.

FIELD OF INVENTION

This application is related to an apparatus and method for providing andconfiguring an elevated, indented, or texturized display device.Moreover, processes are provided and described involving elevated,indented, or texturized portions of a display device.

BACKGROUND

Display devices have become commonplace in electronic devices such asmobile devices, cellular phones, personal digital assistants, smartphones, televisions, monitors, touchscreens, picture frames, or thelike. Display devices may be based on liquid crystal, plasma, or organiclight emitting technologies using ridged substrates or soon to beflexible substrates. Although commonplace, when a display devicefunctions as an input device, such as a touchscreen, their applicationsare limited to two dimensions. Another limitation or problem of currentdisplay devices is the lack of texture. As the world becomes moreelectronic, texture is needed for enhancing and enabling certainapplications and computer processes. Therefore, it is desirable to havedisplay devices that can provide three dimensional and/or texturizedstructures or processes.

SUMMARY

An apparatus and method for providing and configuring an elevated,indented, or texturized display device is disclosed. Processes are alsogiven involving elevated, indented, or texturized portions of a displaydevice. By providing an elevated, indented, or texturized display deviceenhanced input/output functions are provided.

BRIEF DESCRIPTION OF THE DRAWINGS

A more detailed understanding may be had from the following description,given by way of example in conjunction with the accompanying drawingswherein:

FIG. 1 is a diagram of an electronic device having an elevated,indented, or texturized display device in accordance with oneembodiment;

FIGS. 2a-2e are diagrams of elevated, indented, or texturized displaydevices in accordance with another embodiment;

FIG. 3 is a diagram of an elevated or texturized display device inaccordance with another embodiment;

FIG. 4 is a diagram comprising of processes for an electronic devicehaving a display device with elevated, indented, or texturized displayportions in accordance with another embodiment;

FIG. 5 is a process for detecting objects or shapes using a displaydevice with an elevated, indented, or texturized display portions inaccordance with another embodiment;

FIG. 6 is a process using an elevated, indented, or texturized displaydevice in accordance with another embodiment; and

FIG. 7 is a process using an elevated, indented, or texturized displaydevice for identifying intellectual property assets in accordance withanother embodiment.

DETAILED DESCRIPTION

The present invention will be described with reference to the drawingfigures wherein like numerals represent like elements throughout. In thedescription forthcoming, elevation or elevated describes an orientationwhere a given surface level is higher or raised relative to anothersurface level. As an example, the relative elevation may be by one ormore millimeters to one or more centimeters or up to an inch. Indentingdescribes an orientation where a given surface level is lower ordepressed relative to another surface level. As an example, the relativeindentation may be by one or more millimeters to one or morecentimeters. Texturizing or texturing describes a process where asurface provides or mimics friction, variable smoothness, sandpaper likegranularity, variable thickness, variable hardness, coarseness,fineness, irregularity, a movement sensation, bumpiness, or rigidnessthat is sensed by a human touch or detectable by electronic ormechanical sensors.

In addition, lines shown in the accompanying figures for areas havingelevated, indented, or texturized portions or cells are for illustrativepurposes. Actual display devices may not show lines on the displaysurface. In addition, in the processes described below the steps recitedmay be performed out of sequence and substeps not explicitly describedor shown may be performed by one of ordinary skill in the art.

FIG. 1 is a diagram of a fixed or mobile subscriber unit, user equipment(UE), mobile station, pager, cellular telephone, personal digitalassistant (PDA), computing device, surface computer, monitor, generaldisplay, automobile computer system, vehicle computer system, ortelevision device 100 for mobile or fixed applications. Device 100comprises computer bus 140 that couples one or more processors 102, oneor more interface controllers 104, memory 106 having software 108,storage device 110, power source 112, one or more displays controller120. In addition to one or more displays controller 120, device 100comprises a display(s) elevation, indenting, or texturizing controller121 for one or more display devices 122.

One or more display devices 122 can be configured as a liquid crystaldisplay (LCD), light emitting diode (LED), field emission display (FED),organic light emitting diode (OLED), or flexible OLED display device.The one or more display devices 122 may be configured, manufactured,produced, or assembled based on the descriptions provided in US PatentPublication Nos. 2007-247422, 2007-139391, 2007-085838, or 2006-096392or U.S. Pat. No. 7,050,835 or WO Publication 2007-012899 all hereinincorporated by reference as if fully set forth. In the case of aflexible display device, the one or more electronic display devices 122may be configured and assembled using organic light emitting diodes(OLED), liquid crystal displays using flexible substrate technology,flexible transistors, field emission displays (FED) using flexiblesubstrate technology, as desired. One or more display devices 122 can beconfigured as a touch screen display using resistive, surface-acousticwave (SAW) capacitive, infrared, strain gauge, optical imaging,dispersive signal technology, acoustic pulse recognition, frustratedtotal internal reflection or magneto-strictive technology, as understoodby one of ordinary skill in the art.

Coupled to one or more display devices 122 are pressure sensors 123 andoptionally heating elements 127. Coupled to computer bus 140 are one ormore input/output (I/O) controller 116, I/O devices 118, GPS device 114,one or more network adapters 128, and one or more antennas 130. Device100 may have one or more motion, light, optical, chemical,environmental, water, acoustic, heat, temperature, radio frequencyidentification (RFID), biometric, face recognition, image, or voicerecognition sensors 126 and touch detectors 124 for detecting any touchinputs, including multi-touch inputs, for one or more display devices122. One or more interface controller 104 may communicate with touchdetectors 124 and I/O controller 116 for determining user inputs todevice 100.

Shape detectors 125 may be configured in combination with touchdetectors 124, display(s) elevation, indenting, or texturizingcontroller 121, one or more display devices 122, pressure sensors 123,or sensors 126 to determine the shape, geometry or texture of an objectplaced on one or more display devices 122, as will be explained in moredetail below.

Still referring to device 100, storage device 110 may be any disk basedor solid state memory device for storing data. Power source 112 may be aplug-in, battery, solar panels for receiving and storing solar energy,or a device for receiving and storing wireless power as described inU.S. Pat. No. 7,027,311 herein incorporated by reference as if fully setforth. One or more network adapters 128 may be configured as a TimeDivision Multiple Access (TDMA), Code Division Multiple Access (CDMA),Orthogonal Frequency-Division Multiplexing (OFDM), OrthogonalFrequency-Division Multiple Access (OFDMA), Global System for Mobile(GSM) communications, Enhanced Data rates for GSM Evolution (EDGE),General Packet Radio Service (GPRS), cdma2000, wideband CDMA (W-CDMA),long term evolution (LTE), 802.11x, Wi-Max, mobile Wi-MAX, Bluetooth, orany other wireless or wired transceiver for modulating and demodulatinginformation communicated via one or more antennas 130. Additionally, anyof devices, controllers, displays, components, etc. in device 100 may becombined, made integral, or separated as desired.

FIGS. 2a-2e are diagrams of elevated, indented, or texturized displaydevices. In FIG. 2a layer 204 lays in proximity to display device layer202 with layer 203 providing separation. Although a single layer isshown, layers 202, 203, and 204 can be composed of a plurality ofsublayers. In one embodiment, a particular sublayer within 204 can betransflective to reflect any ambient light and emit white light, such asthe average light emitted by surrounding display pixels or cells, sothat the displayed image is clear. Display device layer 202 can beeither a flexible or rigid display device. Layer 204 can be configuredand composed of a clear, flexible, electroactive polymer, polymercomposite, or gel material. Electroactive polymers (EAPs), also known aselectroactive plastics, can be pulled, expand, contract, deform, changeshapes in controllable directions, change dimensions in predetermineddirections, or change sizes electronically by applying an electriccurrent, potential difference, voltage, time varying voltage, orelectromagnetic fields across the material, as described in U.S. Pat.No. 6,117,296, U.S. Pat. No. 6,787,238, US Patent Publication No.2008-188907, US Patent Publication No. 2004-199232, US PatentPublication No. 2005-157893, WO Publication 2007-114699 and “ElectricFlex” by Yoseph Bar-Cohen (2001) all herein incorporated by reference asif fully set forth.

Electroactive polymers (EAPs) may be dielectric or ionic EAPs. Fordielectric EAPs, actuation can be caused by electrostatic forces betweentwo electrodes that squeeze or compress the polymer. Although requiringa high actuation voltage, dielectric EAPs consume very little power andrequire no power to keep an actuator at a given position. Examples ofdielectric EAPs are electrostrictive polymers and dielectric elastomersthat are used for artificial muscles. For Ionic EAPs, actuation iscaused by the displacement of ions inside the polymer. Only a few voltsare needed for actuation, but the ionic flow implies a higher electricalpower needed for actuation, and energy is needed to keep the actuator ata given position. Examples of ionic EAPs are conductive polymers, ionicpolymer-metal composites (IPMCs), and responsive gels.

In another embodiment, layer 204 can also be configured and composed ofpiezoelectric materials or actuators that are bonded to a firm plasticcomponent to form a piezo bending element, as explained in “TPaD:Tactile Pattern Display” by Colgate and Peshkin (2007) hereinincorporated by reference as if fully set forth. When a potentialdifference is applied to a bonded or constricted piezoelectric materialit changes shape. The shape change can be controlled electrically toprovide different surface textures, indentation, and elevation.

In another embodiment, layer 204 can also be configured and composed oforganic transistors formed on a flexible substrate to drive or contracta surface creating texture, indentation, or elevation. Organictransistors are transistors that use organic molecules rather thansilicon for their active material. An advantage of organic transistorsis the ability to operate on a flexible substrate. Similar to EAPs,organic transistors also exhibit material properties such that they canbe pulled, expand, contract, deform, change shapes in controllabledirections, change dimensions in predetermined directions, or changesizes electronically by applying an electric current, potentialdifference, voltage, time varying voltage, or electromagnetic fields.

Still referring to FIG. 2a , portions of surface 216 are selectivelyelevated, indented, or texturized with one or more substantially cubiclesegment 206, dot or dimple segment 208, substantially cylindricalsegment 210, bulge segment 212, or indentation segment 214. The shapeand texture of the indented or elevated portion depends on the image,document, or application to be displayed and the effects on theresolution of the display device. Because of their natural geometry,certain segments may provide a clearer display of the underlying imageor document. Segments 206, 208, 210, 212, and 214 are controlled atleast by displays controller 120 and controller 121 that adjust theheight, indentation, or depression to multiple different levels,orientation, hardness, thickness, direction, vibration, or gyrationindividually for each segment. Display(s) elevation, indenting, ortexturizing controller 121 may comprise of analog or digital drivingcircuits (not shown) for driving the segments. Examples of displaydriving circuits are given in US Patent Publication Nos. 2008-062088,2006-221016, or 2006-007078 all herein incorporated by reference as iffully set forth.

In FIG. 2a , the operation and configuration of layer 204 may beindependent of display device layer 202 thereby simplifyingmanufacturing since it can be an add-on or attachment to preexistingdisplay systems or technologies. Also, in certain applications imagesmay not be displayed on surface 216 in an area that is elevated,indented, or texturized thereby making it darkened in order to make thearea more noticeable to the user. For this configuration, the imagedisplayed on display device layer 202 is rendered to adjust for thedarkened area.

FIG. 2b is a diagram of an elevated or texturized display device. Layer218 lays in proximity to display device layer 220 with layer 219providing separation. Although a single layer is shown, layers 218, 219,and 220 may be composed of a plurality of sublayers. Display devicelayer 220 is configured as a flexible display device, such as flexibleOLED. Layer 218 may be comprised of the same composition or materialsexplained above for layer 204 such as EAPs, piezoelectric materials, ororganic transistors.

In FIG. 2b , portions of surface 231 are selectively elevated ortexturized with one or more substantially cubicle segment 222 ₁controlling segment 222 ₂, dot or dimple segment 224 ₁ controllingsegment 224 ₂, substantially cylindrical segment 226 ₁ controllingsegment 226 ₂, or bulge segment 228 ₁ controlling segment 228 ₂.Segments 222 ₂, 224 ₂, 226 ₂, and 228 ₂ are controlled at least bydisplays controller 120 and/or controller 121 that adjust the height,orientation, direction, or gyration individually or collectively foreach segment. Display(s) elevation, indenting, or texturizing controller121 may comprise of analog or digital driving circuits (not shown) fordriving the segments. Since layer 218 is oriented below or behinddisplay device layer 220, there is little interference with theresolution or clarity of images to be displayed on display device layer220. Also, in certain applications images may not be displayed onsurface 231 in an area that is elevated, indented, or texturized therebymaking it darkened in order to make the area more noticeable to theuser. For this configuration, the image displayed on display devicelayer 220 is rendered to adjust for the darkened area.

FIG. 2c is a diagram of an elevated, indented, or texturized displaydevice. Display pixels 232 ₁ to 232 _(n) lay adjacent, on the samelevel, or on the same layer to elevation, indenting, or texturizingcells 234 ₁ to 234 _(n). The display array or matrix 233 also comprisesof display pixels 236 ₁ to 236 _(n) adjacent to elevation, indenting, ortexturizing cells 238 ₁ to 238 _(n) that are adjacent to display pixels240 ₁ to 240 _(n). The elevation, indenting, or texturizing cells may becomprised of the same composition or materials explained above for layer204 or 218 such as EAPs, piezoelectric material, or organic transistors.Cells 234 ₁ to 234 _(n) and 238 ₁ to 238 _(n) are controlled at least bydisplays controller 120 and/or controller 121 that adjust the height,orientation, direction, or gyration individually or collectively foreach cell. Display(s) elevation, indenting, or texturizing controller121 may comprise of analog or digital driving circuits (not shown) fordriving the cells. In this embodiment, cells 234 ₁ to 234 _(n) and 238 ₁to 238 _(n) may be illuminated based on the configuration of surroundingpixels to blend in with any images being displayed.

FIG. 2d shows an embodiment of a display device array or matrix 235 froma top view where elevation, indenting, or texturizing cells 239 areplaced selectively within a small area footprint so that the surface ofdisplay device array or matrix 235 is mostly comprised of display pixels237. Having texturizing cells 239 sparsely placed in display devicearray or matrix 235 ensures minimal interference with a displayed image.In this embodiment the elevation, indented, or texturized cells may beunnoticeable to the human eye but detectable by touch or feeling ofdisplay device array or matrix 235.

FIG. 2e is a diagram of an elevated, indented, or texturized displaydevice. In FIG. 2e , display pixels 242 are in the same layer or levelbut separate from elevation, indenting, or texturizing cells and displaypixels areas 244 and 246. FIG. 2e provides a hybrid layout with displaypixels 242 operating with selectively placed elevation, indenting, ortexturizing cells and display pixels 244 and 246. In FIG. 2e , area 244can provide scrolling functions while area 246 can be configured as akeyboard, dialpad, keypad, or any other interface.

FIG. 3 is a diagram of an elevated or texturized display device. Amatrix of pockets or cells 304 ₁ to 304 _(x), lays on top of a displaydevice 302. Matrix of pockets or cells 304 ₁ to 304 _(x), may be full ofcompressed air or low heat activated gel that becomes elevated ortexturized by heating elements 127 as a result of thermal expansion, asunderstood by one of ordinary skill in the art. Matrix of pockets orcells 304 ₁ to 304 _(x), can be tapered but flat and seamless whenunexpanded. Moreover, heating elements 127 can be used to providedifferent tactile sensations in combination with pockets or cells 304 ₁to 304 x. so that a user is provided varying temperatures, such as hotor cold information, relating to a displayed image.

FIG. 4 is a diagram illustrating processes for an electronic devicehaving a display device 402 with elevated, indented, or texturizeddisplay portions. Display device 402 can be assembled with at least someof the components described in device 100. For elevated, indented, ortexturized applications, display device 402 may be configured with thedevices described in FIG. 2a, 2c , or 2 d, as desired. For elevated orcertain texturized applications, display device 402 may be configuredwith the devices described in FIG. 2b or 3, as desired. For illustrativepurposes, in FIG. 4 a darkened or black portion represents an indentedportion, a white portion represents an elevated portion, and a checkeredpattern represents a texturized portion.

For inputting data or triggering a request action, a “click here”displayed link is provided with a combination of an indented portion 404₁ and elevated portion 404 ₂. Moreover, part of a virtual or simulatedkeyboard displayed on display device 402 provides the letter “E” keywith a partially displayed portion 406, an elevated circular portion 414and an elevated square portion 408. Although part of a virtual orsimulated keyboard is shown, display device 402 can be configured toshow a whole QWERTY keyboard, a numbered keypad for dialing, or acombination of a whole QWERTY keyboard and a numbered keypad, asdesired. The letter “S” key is provided by a partially displayed portionand an elevated circular portion 410. The letter “Q” key is completelyelevated by portion 412. The virtual or simulated keyboard can also beprogrammed to replicate Braille lettering, as desired.

In addition to key inputs, portions 414, 408, 410, or 412 can detectdifferent pressure forces when pushed down, pushed sideways, or pulledsideways providing another metric or advantage for the man machineinterface. For instance, a pull in one direction may indicate a capitalletter input while a push in another direction may indicate subscriptingof the letter. These different pressure forces are detected by pressuresensors 123 in combination with touch detectors 124 and/or display(s)elevation, indenting, or texturizing controller 121 by measuringgradient, force, or potential difference values. Moreover, in responseto a detected force by pressure sensors 123 and touch detectors 124,haptic feedback, force feedback or tactile feedback in the form of aplayed sound, gyration, or vibration can be provided via I/O controller116.

Still referring to the virtual or simulated keyboard on display device402, instructions in software 108 can be used to predict or anticipatekeystrokes based on a word or sentence entered. In response to theanticipation, different keys can be raised, indented, or texturized inorder to increase typing speeds.

An embodiment of the present invention provides electronic advertisingprocesses. Advertisement 416 can be sold to an advertiser for a certainprice for having elevated portions 416 ₁ and 416 ₃ and indentation 416 ₂on at least one part or the entire advertisement. Advertisement 418 canbe sold to an advertiser for a different price, higher or lower, forhaving elevated portions 418 ₁ and 418 ₂ having different heights fromother advertisements and can be based in combination with locationdetermined by GPS device 114. Advertisement 419 can be sold to anadvertiser for a different price for having a plurality of elevated,indented, or texturized portions 419 ₁.

An embodiment of the present invention provides electronic businessprocesses. A “Buy Now” button is provided with an elevated circularportion 422 ₁ and a square portion 422 ₂. The “Buy Now” button isassociated with triggering the purchasing of shirt 424 by sending arequest to a server (not shown) over one or more network adapters 128.For shirt 424, a texturizing portion 426 is provided to replicate orsimulate the surface of shirt 424. Texturizing portion 426 can be acombination of elevated and indented cells. Although a shirt 424 isshown, texturizing portion 426 can be used to provide surfaceinformation for any product being sold or displayed on display device402 such as electronics, home goods, jewelry, etc.

Using touch detectors 124 in combination with display(s) elevation,indenting, or texturizing controller 121, shirt 424 can be rotated inresponse to a multitouch input while texturizing portion 426 isdynamically changed to reflect the different surfaces or materials usedin the product. Shirt 424 can be zoomed in and out using multitouchinputs detected by touch detectors 124 with each zoom level reflectingtexture differences on portion 426. For instance, a zoomed in view canbe more grainy or rough compared to a zoomed out view. The zoom levelscan also be configured with a fading in or out effect by one or moreprocessors 102 and can involve retrieving additional information from aserver (not shown) over one or more network adapters 128. Moreover, ifcertain rare or uncommon materials cannot be replicated or simulated bytexturizing portion 426, legend 425 identifies or associates differentmaterials, such as rabbit skin, llama wool, and rare silk, by texturizedportions 425 ₁, 425 ₂, and 425 ₃, respectively. Beyond the examples offabrics, other materials like metals, plastics, glass, wood, etc. can bereplicated or simulated by texturizing portion 426.

Still referring to FIG. 4, an embodiment of the present inventionprovides an electronic game with elevated, indented, or texturizingportion 428 (hereinafter “portion 428”), such as tic-tac-toe. Portion428 can detect different pressure forces when pushed down, pushedsideways, or pulled sideways providing another metric or feature for theman machine interface. These different pressure forces can be detectedby pressure sensors 123 in combination with touch detectors 124 and/ordisplay(s) elevation, indenting, or texturizing controller 121 bymeasuring gradient, force, or potential difference values of touches toraised portions in portion 428. Another gaming application comprisesportion 428 emulating a piano or guitar.

Moreover, a game can receive as inputs flicks, pinches, or scratches toportion 428 and generate an action on display device 402 in response toeach detected action differently. A pinch to a raised portion of 428 canrepresent an object or block being picked up or opened in a game or anyother simulated environment. Portion 428 can also control scrolling ordrag and drop functions in combination with multitouch inputs detectedby touch detectors 124. In another embodiment, certain portions 428 canbe used as a miniature joystick or pointing stick for 360 degreesrotational input that is detected by pressure sensors 123 in combinationwith touch detectors 124 and/or display(s) elevation, indenting, ortexturizing controller 121. A three dimensional accelerometer can beincluded in sensors 126 to be used in combination with display(s)elevation, indenting, or texturizing controller 121 to raise part ofportion 428 in response to a programmed action in the game. Portion 428can also be used to simulate or replicate a lottery scratching/rubbinggame or a children's productivity game, as desired. Portion 428 can alsoprovide a gaming feature where tilting or rotation detected by anaccelerometer in sensors 126 raises some portions while indenting othersfor four dimensional motion gaming.

In another embodiment, portion 428 can provide online collaboration,online conferencing, social networking, or online dating. In response topush or pull input on a networked computing device (not shown) having anelevated, indented, or texturized display device, portion 428 providesfeedback, similar to a poke on Facebook. In online conferencing, tactileinputs to portion 428 can be used during a video conference applicationfor additional interaction between conversing parties. For socialnetworking, adult entertainment can be enhanced by portion 428 providingstimulation in connection with a video, image, or audio media on displaydevice 402.

Additional processes exist within the medical field for onlinecollaboration. Portion 428 can provide remote medical diagnostics andmeasurements, such as a pressure test, over a network using one or morenetwork adapters 128 and pressure sensors 123 in combination with touchdetectors 124 and/or display(s) elevation, indenting, or texturizingcontroller 121. Diagnostics and measurements include tactile for motorskills, respiratory for testing lung pressure by a person blowing onportion 428, or muscular by measuring range of motion and strength, asdesired. Therefore, portion 428 can provide bi-directional informationexchange.

Still referring to medical processes, portion 428 can be used for theelderly or disabled to provide simple, small scale physical therapyexercises for the hand or fingers by allowing a user to pull raisedportions at different tensions and resistances or pickup objects. Thisis particularly useful for stroke victims by providing mental therapy,exercises and massaging of small muscles and ligaments.

In another embodiment, portion 428 can be used to provide a plurality ofprocesses or applications. Portion 428 can simulate maps, topography,geography, imagery, or location service processes in combination withGPS device 114. Portion 428 can display mountainous regions on a map byelevating and oceans by indenting. Portion 428 can follow a musicalsequence being played on device 100 for a ringtone during a receivedcall or song. Moreover, portion 428 can be used to display content in anemail, 3rd Generation Partnership Project (3GPP) or 3GPP2 short messageservice (SMS) text message, 3GPP or 3GPP2 multimedia message service(MMS) message, an image or video motion in an MMS message, PDFapplication, word document, excel graphs, excel charts, four dimensional(4-D) screensaver, 4-D art, 4-D drawings, 3-D imagery, a 3-D sculpture,a 4-D “etch-a-sketch”, or architecture designs using scalable or vectorgraphics. Any of the content given above and displayed by portion 428may be transmitted or received over one or more network adapters 128.

Moreover, portion 428 can provide, replicate, or simulate integratedcircuit layouts, electrical circuit layouts, facial features, enhancedvideo clips, computer aided designs (CAD), semiconductor layouts,prototyping, modeling, molding for producing form factors, logos,trademarks, a children's educational product, a general educationproduct, a 3-D drawing tool, distance learning, or a pop-up children'sbooks, as desired. In addition, portion 428 can be responsive to voiceor visual commands or recognition detected by sensors 126 for beingelevated, indented, or texturized.

Moreover, portion 428 can provide object awareness to display device402. For instance, a post it note can be detected when it is determinedthat there is additional resistivity or elasticity by the adhesive onthe post it note by pressure sensors 123 and in combination with touchdetectors 124 and/or display(s) elevation, indenting, or texturizingcontroller 121 to raised or elevated cell in portion 428. In response tothe detected post it, display device 402 can adapt and reformat theimages around the note such that images are not obstructed to the user.

Moreover, portion 428 can provide advanced Bluetooth capabilities forBluetooth keyboards, headsets and can function as a Bluetooth deviceitself for medical applications. When a call is received over one ormore network adapters 128, a preprogrammed texturized pattern isreproduced on portion 428 for notifying the user, such as when displaydevice 402 is in a shirt pocket in hands-free mode communicating with awireless headset. Alternatively, the texturized pattern reproduced onportion 428 during an incoming call can be controlled, designed, orcustomized by the calling party if the function is enabled on device100.

Still referring to FIG. 4, another embodiment provides object detectionfor a 3-D object that is placed on area 429 having a combination ofelevated cells, indented cells, and/or texturized cells. FIG. 5 is aprocess 500 for detecting objects or shapes using elevated, indented, ortexturized display portions. Although process 500 can be performed bydevice 100 in a fat client architecture, device 100 can also beconfigured as a thin client by sharing shape detection processingfunctions with a server (not shown) using one or more network adapters128. Cells are selectively raised around an object placed on area 429 bydisplay(s) elevation, indenting, or texturizing controller 121 (step502). The weight of the object is detected by pressure sensors 123 andshape detectors 125 and a height graph of the surface of the object isgenerated by one or more processors 102 (step 504). The perimeter of theobject placed on area 429 is determined by one or more processors 102and shape detectors 125 by raising or lowering cells in proximity toobject by display(s) elevation, indenting, or texturizing controller 121(step 506). One or more processors 102 calculate gradients values (step508) and generates a surface graph (step 510) based on the previousmeasurements made.

Moreover, display device 402 may have infrared detectors 430 ₁-430 ₄ ina slightly beveled position or in the level with the frame of displaydevice 402. Display device 402 may also have digital cameras 434 ₁-434 ₄for capturing, tracking, and detecting shapes using algorithms such asthat described in U.S. Pat. No. 7,317,872, herein incorporated byreference as if fully set forth, that can be used to perform additionalsensor measurements (step 512). Other sensor measurements for additionalmetrics and refinement include infrared or optical detection to detectdepth. These sensors can be embedded next to or within each display cellin display device 402. Based on steps 502-512, a preliminary image maybe rendered by one or more processors 102. The preliminary image can becompared and matched against a database of images in storage 110, orstored remotely, using artificial intelligence algorithms. Informationis then retrieved by one or more network adapters 128 based on thedetected object and/or preliminary image (step 514).

In a process involving area 429 and process 500, a ring size is detectedand related information, such as from an online jewelry stored, isretrieved over one or more network adapters in response. Alternatively,the size and type of certain household goods, such as hardware, screws,nuts, light bulbs, batteries can be determined by area 429 and process500. Moreover, a key placed on area 429 can be keyed and the informationsent over one or more network adapters 128 for subsequent duplicationand mail delivery by an online store. In addition, process 500 can beused to obtain biometric information for security purposes.

In another process involving area 429, intellectual property assets,such as patents, trademarks, or copyrights, relating to the shape of adetected object is retrieved and displayed in a map format in displaydevice 402 to show a correspondence between similar features of anobject and related intellectual property assets. FIG. 7 is a processusing an elevated, indented, or texturized display device foridentifying intellectual property assets. The shape of a widget 702placed on area 429 is detected by process 500 and digitally rendered.The detected shape of the widget 702 is compared against widgets 706 ₁,706 ₂, or 706 ₃ shown and described in U.S. Pat. No. X (704) stored in adatabase. The comparison between widgets can be performed graphicallyusing image rendering, as understood to one of ordinary skill in theart. Moreover, artificial intelligence algorithms can be used to compareclaim text or descriptions 710 in U.S. Pat. No. X (704) against featuresdetected by area 429 and process 500. If a match is determined or found,the widget 702 is associated with U.S. Pat. No. X (708) and displayed ina map format on display device 402.

In another embodiment, display device 402 replicates, mimics, orsimulates a customizable or programmable interface or control panel fora remote control, instrument panel on a vehicle, an automobile dashboardconfiguration, audio equalizers, multitouch equalizers, radio buttonlist, or a consumer electronics button surface with raised buttonportions 432 ₁-432 ₃. The simulated interface can be used to sellconsumer electronics or function as an advanced user guide wherebyinput, output, and programming functions are simulated with buttonportions 432 ₁-432 ₃ that have the same size and shape as the actualbuttons on a product. Moreover, 432 ₁-432 ₃ can be programmed forcontrolling volume control, replicating smart home switches orcontrollers, as desired.

Still referring to FIG. 4, advanced web searching 436 is performed bymeasuring pressure applied or detecting depth perception to raised orelevated portion 438. Web searching 436 can be used in combination witharea 429 to display hits or webpages relevant to detected objects.

FIG. 6 is a process 600 using an elevated, indented, or texturizeddisplay device that can be selectively performed by the display devicesdescribed above. Information is received from one or more networkadapters 128, I/O devices 118, or storage device 110 (step 602). Thesector of cells to be elevated, indented, or texturized based on thereceived information is checked and tested by display(s) elevation,indenting, or texturizing controller 121 and display controllers 120(step 604) to determine how a high image quality in the area can bemaintained (step 606) by raising or lowering selective cells. One ormore processors 102 in combination with sensors 126 determine displayorientation or viewing angle (step 608) that is taken into considerationto properly elevate, indent, or texturize the display devices describedabove. If an image of an object is to be simulated or replicated, it isrendered by one or more processors 102 and checked to determine if itcan be properly displayed (step 610). The cells in the display deviceare elevated, indented, or texturized (step 612).

Although features and elements are described above in particularcombinations, each feature or element can be used alone without theother features and elements or in various combinations with or withoutother features and elements. The methods, processes, or flow chartsprovided herein may be implemented in a computer program, software, orfirmware incorporated in a computer-readable storage medium forexecution by a general purpose computer or a processor. Examples ofcomputer-readable storage mediums include a read only memory (ROM), arandom access memory (RAM), a register, cache memory, semiconductormemory devices, magnetic media such as internal hard disks and removabledisks, magneto-optical media, and optical media such as CD-ROM disks,digital versatile disks (DVDs), and BluRay discs.

Suitable processors include, by way of example, a general purposeprocessor, a special purpose processor, a conventional processor, adigital signal processor (DSP), a plurality of microprocessors, one ormore microprocessors in association with a DSP core, a controller, amicrocontroller, Application Specific Integrated Circuits (ASICs), FieldProgrammable Gate Arrays (FPGAs) circuits, any other type of integratedcircuit (IC), and/or a state machine.

A processor in association with software may be used to implement aradio frequency transceiver for use in a computer, wireless transmitreceive unit (WTRU), user equipment (UE), terminal, base station, radionetwork controller (RNC), or any host computer. The WTRU may be used inconjunction with modules, implemented in hardware and/or software, suchas a camera, a video camera module, a videophone, a speakerphone, avibration device, a speaker, a microphone, a television transceiver, ahands free headset, a keyboard, a Bluetooth® module, a frequencymodulated (FM) radio unit, a liquid crystal display (LCD) display unit,an organic light-emitting diode (OLED) display unit, a digital musicplayer, a media player, a video game player module, an Internet browser,and/or any wireless local area network (WLAN) or Ultra Wide Band (UWB)module.

What is claimed is:
 1. A mobile electronic device comprising: amulti-touch display layer, of the mobile electronic device, configuredto display an image, wherein a tactile area on a clear layersubstantially on the multi-touch display layer is associated with theimage; a processor configured to display, on the multi-touch displaylayer, a view of information based on applied force from a detectedtouch to the tactile area and a detected indentation level of the clearlayer, wherein the applied force is detected by a layer of sensorssubstantially behind the multi-touch display layer and the indentationlevel is detected in part with accelerometer based information; and theprocessor further configured to display, on the multi-touch displaylayer, a menu based on a detected further indentation of the tactilearea on the clear layer.
 2. The mobile electronic device of claim 1further comprising: the mobile electronic device is configured toprovide a programmable vibration in relation to a zoom operation of theimage.
 3. The mobile electronic device of claim 2, wherein apiezoelectric device or an electroactive polymer (EAP) device isconfigured to provide the vibration.
 4. The mobile electronic device ofclaim 1, wherein the tactile area is changed responsive to at least oneof a scrolling or drag and drop input detected by the mobile electronicdevice.
 5. The mobile electronic device of claim 1 further comprising:circuitry configured to raise, by the mobile electronic device, thetactile area to a height above the multi-touch display layer.
 6. Themobile electronic device of claim 1, wherein a vibration or a texturepattern is provided in association with the detected further indentationlevel.
 7. The mobile electronic device of claim 1, wherein the clearlayer is an electro-active polymer layer.
 8. The mobile electronicdevice of claim 1, wherein the multi-touch display layer is a flexibleOLED display.
 9. A method performed by a mobile electronic device, themethod comprising: displaying, by a multi-touch display layer of themobile electronic device, an image, wherein a tactile area on a clearlayer substantially on the multi-touch display layer is associated withthe image; displaying, by the mobile electronic device on themulti-touch display layer, a view of information based on applied forcefrom a detected touch to the tactile area and a detected indentationlevel of the clear layer, wherein the applied force is detected by alayer of sensors substantially behind the multi-touch display layer andthe indentation level is detected in part with accelerometer basedinformation; and displaying, by the mobile electronic device on themulti-touch display layer, a menu based on a detected furtherindentation of the tactile area on the clear layer.
 10. The method ofclaim 9 further comprising: providing, by the mobile electronic device,a programmable vibration in relation to a zoom operation of the image.11. The method of claim 10, wherein a piezoelectric device or anelectroactive polymer (EAP) device provides the vibration.
 12. Themethod of claim 9, wherein the tactile area is changed responsive to atleast one of a scrolling or drag and drop input detected by the mobileelectronic device.
 13. The method of claim 9 further comprising:raising, by the mobile electronic device, the tactile area to a heightabove the multi-touch display layer.
 14. The method of claim 9, whereina vibration or a texture pattern is provided in association with thedetected further indentation level.
 15. The method of claim 9, whereinthe clear layer is an electro-active polymer layer.
 16. The method ofclaim 9, wherein the multi-touch display layer is a flexible OLEDdisplay.